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ITEM  IDENTITIES  AND  THEIR  RELATED  OBSERVABLES 

D.  P.  Gaver 
P.  A.  Jacobs 


Abstract 

Each  of  J  items  has  a  characteristic  Signature  which  varies  in  time.  At 
time  0,  the  value  of  a  Signature  and  the  identity  of  the  corresponding  item  are 
known.  No  further  values  of  Signatures  are  observed  until  a  later  time  t>0. 
At  time  t,  a  Signature  from  an  unknown  item  is  observed.  The  problem  is  to 
estimate  the  identity  of  the  item  whose  Signature  is  observed  at  time  t.  The 
estimation  procedure  studied  is  to  estimate  the  identity  of  the  unknown  item 
to  be  that  one  which  maximizes  the  posterior  probability  of  producing  the 
observed  Signature. 

Key  Words:  Classification;  Bayesian  Paradigm;  autoregressive  process 


ITEM  IDENTITIES  AND  THEIR  RELATED  OBSERVABLES 

D.  P.  Gaver 
P.  A.  Jacobs 


1.     The  Problem 

We  are  concerned  with  a  diagnostic  problem  that  may  occur  in  many 
applied  areas,  with  medicine  and  mechanical  system  reliability  furnishing 
handy  examples. 

Suppose  there  are  J  Items  (e.g.,  diseases  or  faults),  each  of  which  has  a 
characteristic  Signature  which  varies  in  time;  the  Signature  of  Item  i  is 

1    O  T 

Yi(o  =  9i  +  Xi(t)       t  =  oxi..  (11) 

For  the  moment  {X,(t)}  is  an  unspecified  univariate  stochastic  process,  but  one 
that  loosely,  has  the  property  of  staying  near  84  in  finite  time,  and  for 
convenience  has  some  stationary  or  steady-state  behavior.  One  could  think  of 
Yi(t)  as  a  physical  index  characteristic  of  a  particular  disease  or  disability,  e.g., 
blood  pressure,  heart-beat  pattern,  mechanical  vibration  spectrum,  etc. 

Suppose  that  Yj(t)  is  only  evident  or  observable  occasionally  at  times 
unrelated  to  the  magnitude  of  Yj(t),  but  driven  by  other  forces  (this  is  a  bit 
implausible  in  some  situations  because  a  high  blood  pressure  or  temperature 
may  actually  induce  medical  observation;  the  formulation  can  be  changed  to 
reflect  this  later).  Suppose  that  the  Signature  and  the  identity  of  an  item  are 
both  observed  at  time  t=0.  Suppose  that  later  on,  at  time  t,  only  the  Signature 
of  an  item  is  observed.  The  first  question  is:  what  is  the  probability  that, 
given  the  Signature  value  observed,  its  originating  item  is  any  particular  one 
of  a  list  of  candidates,  e.g.,  i=13  out  of  a  particular  list  j=l,  2, ...  13, ...  J  =  39? 


2.     Question:  Who  is  Being  Observed? 

Here  we  become   quite  specific,   assuming   for  illustration  that  the 
Signature  of  Item  j  is  AR(1): 


Yj(t)  =  6)  +  Xj(t), 


(2.1) 


where 


Xj(t)  =  pjXj(t-l)  +  e/t),     t  =  0, 1,  2, ...,  17, .. 


(2.2) 


with  (£j(t)}  ~  ED  N  (0,0; ).    For  the  moment  assume  that  the  basic  constants  0j, 
j  =  1,  2, ...,  J  are  known,  as  are  the  correlations  I  pj  I  <  1  and  the  variances  0";. 


If  I  pjl  <  1  then,  given  Xj(0),  Xj(t)  is  Normal/Gauss 


( 


Xj(t)  I  Xj(0)  ~  N 


Xj(0)pJ,aj(t)  =  Oj 


V 


1-p 


2t 


1-Pi 


\ 


Jy 


or,  in  terms  of  the  actual  observable  Yj(t), 


Yj(t)  I  Yj(0)  ~  N((Yj(0)-ej)p|  +  0J,  Oj(t)) 


(2.3) 


(2.4) 


Apparently  if  t  runs  on  indefinitely,  its  distribution  approaches 


N 


Gj,Oj(oo)  L  with  Oj(°o)  =  Oj  /  1-p 


(2.5) 


Scenario:  Suppose  there  are  potentially  J  items  around,  but  admit  the 
possibility  that  each  can  vanish,  so  that  there  is  some  probability,  which  may 
be  less  than  one,  that  the  item  will  actually  be  "around"  at  time  t.  Let  the 
probability  that  one,  the  jth,  is  present  at  t  be  pj  (t).  Next,  let  Sj(t)  be  the 
probability  that  the  jth  be  observable,  e.g.,  is  emitting  sounds,  given  that  it  is 
present;  assume  independence  between  items.  All  of  this  is  preliminary,  and 
can  (and  should)  be  modified  as  required.  Now  consider  that  event 

A)  Item  i  has  been  observed  at  t=0,  and  its  Signature  is  observed /noted  to 
beYi(0)  =  y(0). 


If  it  has  been  a  long  time  since  an  observation  was  made  then  it  is 
plausible  to  take  the  probability  of  the  above  event  as 


P{Yi(0)  e(dy(0)),  1(0)  =  i}  =  Pi(0)  si(0)q> 


1 


ai(oo)    jai(«>) 


dy(0) 


(2.6) 


(p  being  the  N(0,1)  density;  that  is,  we  observe  Item  i  after  his  Signature  is  in 
statistical  equilibrium,  and  measure  time  from  that  (such  an)  instant. 

Time  t  elapses  and  then  for  any  j  (either  the  same  as  i,  or  different) 

B)  Item  j  is  observed  at  time  t>0,  with  Signature  value  Yj(t)  =  y(t). 

Since  the   AR(1)   process   is   Markov,   we  can   write  down   the  joint 
probability 

P{Yi(0)  e(dy(0)),  1(0)  =  i,  Yj(t)  e(dy(t)),  I(t)  =  j}  = 


y(0)-6A  dy(0) 


Pi(0)  si(0)  d  ^j-  ■  5^)  •  Pj(t)  Sj  (t)  9 


Mt)-mj(thdy(t) 


Oj(t) 


Jaj(t) 


(2.7) 


where  we  can  think  of  pj(t)  as  the  conditional  probability  that  j  is  actually 
eligible  for  observation,  and  Sj(t)  as  the  conditional  probability  of  being 
observable.   Note  that  it  is  natural  for  j*i  that 


mj(t)  =  9j 

2      (        2\ 
Gj(t)  =  Gj(°°)  =  Oj  /    1-Pj 


(2.8,a) 
(2.8,b) 


for  at  t  it  is  still  a  "long  time"  since  j(*i)  was  last  observed;  whereas  if  j=i,  the 
same  item  that  was  observed  and  identified  at  t=0,  then 


mj(t)  =  0j  +  (y(OMi)  Pi 


(2.9,a) 


and 


2  2 

ai(t)  =  <Ji 


(    (  2\\ 
1-  Pi 


V 


1-p? 


/ 


(2.9,b) 


It  follows  that 


C)  the  conditional  probability  of  observing  a  particular  item  and 
observing  it  with  Signature  value  y(t)  given  the  initial  condition  Q(0)  = 
{Yi(0),I(0)}  is  just 

P{Yj(t)  e(dy(t)),  I(t)  =  j  I  Cj(0)  =  (y(0),  1(0))}  = 


'/x     ry(t)-mi(t)>|dy(t) 


(2.10) 


where  the  appropriate  mj(t)  and  Oj  (t)  come  from  (2.8)  or  (2.9).  In  words,  (2.10) 
provides  the  probability  of  seeing  or  positively  identifying  a  particular  item,  j, 
and  simultaneously  measuring  its  current  Signature  value,  given  such  a 
complete  observation  at  t=0. 

Next 

J 
D)  p{Y(t)  £(dy(t))  I  Q(0)}    =  Xp{Yjtt)e(dy(t)),  I(t)  =  j  I  Q(0)} 


H 

J 

I 

H 


=  Xpj(t)Sj(t)(p 


'y(t)  -  mj(t)^  dy(t) 
ai(t)- 


aft) 


(2.11) 


This  is  the  probability  that  one  measures  a  Signature  at  t,  but  cannot  make  a 
complete   identification. 

From  (2.10)  and  (2.11)  we  can  calculate  the  probability  of  the  identity  of  the 
item  whose  signature  is  measured  at  time  t,  given  the  last  complete 
observation: 


E)  P{I(t)=j|Y(t)  =  y(t),Q(0)}  = 


tx    /x    fy(t)-mj(tr 
Pj(t)  Sj(t)  cp K       (t)'      y    (t) 


'Jv 


T 


Jpk(t)sk(t)9 


y(t)  -  mk(t) 
Ok(t) 


(2.12) 


aic(t) 


If  one  looks  hard  at  (2.12)  it  seems  clear  that  when  pi>0  and  y(t)  is  near 
y(0),  and  j=i,  the  above  probability  becomes  closer  and  closer  to  unity  as  t 
decreases,  while  if  j*i  that  probability  (that  Item  j*i)  correspond- 
ingly decreases. 


3.     The  Probability  of  Making  the  Wrong  Decision 

In  this  section  we  study  properties  of  making  a  decision  based  on 
choosing  the  item  which  maximizes  the  posterior  probability  of  a  particular 
item  being  the  one  whose  Signature  is  observed  at  time  t  given  the  last 
complete  observation  at  time  0.  For  simplicity  we  will  assume  that  there  are 
two  items  whose  parameters  are  0]  and  62- 

3.1    The  parameters  Q1  and  6^  are  known. 

Suppose  the  parameters  9i  and  62  are  known  and  I  pi  I  <1.  The  condi- 
tional distribution  of  Y(t)  given  Y(0)  =  y(0),  1(0)  =  1,  I(t)  =  1  is  normal  with 
mean 


mi(t)  =  8i  +(y(0)-8i)pt1 


(3.1) 


and  standard  deviation 


01  (t)  =  oi(««) 


V^7 


(3.2) 


Further, 


Y(t)-m2(t)     Y(t)-mi(t)  +  (m1(t)-m2(t)) 


a2(t) 


a2(t) 


(3.3) 


o2(t)       ai(t) 
where  n\2(t)  and  mi(t)  are  given  by  (2.8) 


oi(t)  Y(t)-mi(t)       mi(t)-m2(t) 

+ 


a2(t) 


Assume  that  item  j  will  be  identified  with  the  Signature  at  time  t  if  it 
maximizes  (2.12);  then, 

P  {wrong  item  is  identified  1 1(0)  =  1, 1(t)  =  1,  Y(0)  =  y(0)}  (3.4) 


=  P< 


P2(t)s2(t) 


>  pi(t)si(t) 


1 


2tu  02(f) 

1 


exp 


2k  oi(t) 


exp 


1  (Y(t)-m2(t)) 

2  a2(t) 

I  (Y(t)-mi(t)) 


oi(t) 


I(0)=l,I(t)=l,Y(0)=y(0) 


> 


-HBfiiS^fWc*"***! 


where  Z  has  a  standard  normal  distribution 


c(t)  = 


CTl(t)      ^  /Z     2 
o^(t)  =  V1_Pl 


2t  qi(°°) 

02(°°) 


and 


d(t)  = 


ml(t)-m2(t)    (y(Q)-ei)Pi^ei-e2) 

02(t)  02(°°) 

P  {wrong  decision  |  1(0)  =  1, 1(0=1,  Y(0)  =  y(0)} 


=  P 


P2(0s2(t) 


v^ 


01(00) 


>  ex 


=  P 


pi(t)si(t)  02(00) 


p[-|  [(l-<:(t)2)z2  -  2c(t)d(t)Z  -  d(t)2  ]J 


-2  In 


P2(t)s2(t) 


_pi(t)si(t)  02(00) 

=  P  1  0  <  (l-<:(t)2)Z2  -  2c(t)d(t)Z  -  d(t)2  +  2  In 


<  (l-c(t)2)Z2  -  2c(t)d(t)Z  -  d(t)2 
P2(t)s2(t)      /       2t    ai(~) 


Note  that  as  t-*0      1 


ijl-pi1 


pi(t)si(t) 
and  thus 


02(00) 


(3.6) 


Pfwrong  decision  I  1(0)  =  1, 1(t)  =  1,  Y(0)  =  y}  -*  0. 

Example:  Suppose  oj  =  o   i  =  1,2,  I  pi  I  =  I  p  I  <1,  i=l,2  and  pi(t)si(t)  =  p2(t)s2(t); 
then 


P{wrong  decision  I  1(0)  =  1, 1(t)  =  1,  Y(0)  =  y(0)} 
=  P  {0  <  (l-c(t)2)Z2  -  2c(t)d(t)Z  -  d(t)2  +  2  In  c(t) } 


(3.7) 


with 


and 


d(t)  = 


(y(0)-9i)p*  + (61-62) 


o/Vl-p: 


(3.8,a) 
(3.8,b) 


(6i-62) 
As  t->°o,  d(t)-» ; -,  c(t)-»l  and 


a/VlV2 

P{wrong  decision  I  1(0)  =  1, 1(t)  =  1,  Y(0)  =  y(0)} 

d(oo)| 


l-O 


(3.9) 


where  <I>  is  the  standard  normal  distribution  function.     In  this  case,  the 
conditional  probability  of  making  a  wrong  decision  decreases  as    I  61-62  I 
increases  and  the  probability  increases  as  a  increases. 

For  arbitrary  t  >  0  such  that  c*l, 

P{wrong  decision  I  1(0)  =  1, 1(t)  =  1,  Y(0)  =  y(0)} 


U     c(t)  d(t)\Z 

=  P[Z-l=cO)^J   > 


d(t)2      _  2  In  c(t)j 
(MO?  "T=^rJ 


=  Pi 


P 


_  c(t)  d(t) 
Z"l-c(t)2 


_  c(t)  d(t) 
Z-T^tj2~ 


> 


V 


d(t)2 


(l^c(t)2) 


2  In  c(t) 
l-c(t)2 


m 

V  P4t 


d(t)2      lnd-p2*) 


»2t 


=  1  -  <D  (  Vl^pS"  p~2td(t)  +  k(t))  +  <D  (  Vl-P2t  P"2td(t)  -  k(t))  (3.10a) 


where 


k(t)  =  [d(t)2  p-«  -  p~2*  In  (l-p2t)] 


Note  that  as  t->0,  c(t)-*0  and  the  conditional  probability  of  an  incorrect 
decision  tends  to  zero. 


A  numerically  more  stable  form  of  (3.10a)  is  the  following. 

Pfwrong  decision  1 I(0)=1, 1(t)=l,Y(0)=y(0)}  =  l-cD(Ai)+<D(A2)       (3.10b) 
where 

Ai  =  [-d(t)2  +  21n  c(t)]  [c(t)d(t)  -  Vd(t)2-(l-c(t)2)21nc(t)] "* 

A2  =  [-d(t)2  +  21n  c(t)]  [c(t)d(t)  +  Vd(t)2-(l-c(t)2)21nc(t)] ~* 

The  unconditional  probability  of  a  wrong  classification  can  be  found  by 
taking  the  expected  value  of  (3.10b)  with  respect  to  the  normal  random 
variable  Y(0)  with  mean  6j  and  standard  deviation  a(°°).  The  evaluation  of 
the  integrals  is  performed  numerically  using  Gauss-Hermite  quadration  with 
59  points;  cf.  A.  H.  Stroud  et  al  [1966]  and  Naylor  and  Smith  [1982].  Figures  1 
and  2  show  the  unconditional  probability  of  wrong  classification  at  time  1,  2, 
...,  100  for  parameter  values  6i  =  1,  82  =  2,  a  =  1  and  values  of  p  =  0,  0.5,  0.8,  0.90, 
0.95.  (resp.  curves  A,  B,  C,  D,  E). 

Figure  1  shows  the  probability  of  wrong  classification.  As  noted  above, 
the  probability  of  wrong  classification  is  small  for  small  values  of  t  and  then 
increases  to  a  limiting  value.  For  very  small  times  having  a  larger  p  results 
in  smaller  probabilities  of  error.   It  is  seen  from  (3.9)  that  the  limiting  value  is 

a  function  of  o(©°)  =  a/"\  1-p2  .  Hence  the  larger  p  is  the  larger  the  limiting 
probability  of  wrong  classification.  Thus,  while  for  very  small  times,  having  a 
large  positive  p  decreases  the  probability  of  wrong  classification,  at  larger  time 
it  increases  the  probability  of  wrong  classification. 

In  Figure  2,  each  probability  of  wrong  classification  is  divided  by  its 
asymptotic  value.  These  normalized  probabilities  are  between  0  and  1.  The 
fraction  (relative  to  the  limiting  probability)  of  the  probability  of  wrong 
classification  for  each  time  t  is  monotone  in  p.  For  a  fixed  time  t,  for  a  high  p, 
the  fraction  of  the  probability  of  wrong  classification  is  less  than  or  equal  to 
that  for  a  lower  p.  The  higher  p  is,  the  longer  it  takes  for  the  probability  of 
error  to  reach  its  asymptotic  value. 

3.2.  The  parameters  0i  and  82  have  noninformative  priors. 

In  this  subsection  we  will  assume  that  9i  and  62  have  noninformative 
prior  distributions.   Thus,  assuming  I  pi  I  <1, 
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p{Y(0)edy(0)/eed8|l(0)  =  l} 

exp  j-2  (y(0)  -  6)2/oi(oo)2 1  dy(O)d0 


(2tc  aiM 
Hence,  formally  for  a  non-informative  improper  prior, 

P  {Y(0)£dy(0)  1 1(0)  =  l}  =  l-dy(O) 
and  thus 

p{eedell(0)  =  l,Y(0)  =  y(0)} 

Further, 

P  {Y(t)£dy(t),  GedG  1 I(0)=1, 1(0=1,  Y(0)=y(0)} 

=  V^  expj-lfyco-e-p^yw-e)^)2} 
— —  exp  |4(e-y(0))2/oi(oo)2} 


■\[2ko\(<x>) 


V27lCJl(t)V27CCJl(oo) 

where  the  usual  calculations  yield 


f   1  2  2    1 

exp  |~2  (e-m(t))  /viW-^R 


vi(t)2  = 


T  + 2 

_  ai(t)        ai(~)  _ 


-l 


V, 


i-Pi  bi(°°) 


-i 


(3.11) 


(3.12) 


(3.13) 


(3.14) 


(3.15) 


W(t) 


vi(t) 


2  = 


Pi 


y(t)  -  p*  y(0)    * ^  +  y(0)/ai(oo) 


oi(t) 


(3.16) 


11 


R  = V12°      2    [y(t)  -  y(0)]2  =  [y(t)-y(0)]2/2 

oiM  ai(t) 


ai(oo)  =(5-[/  1-p! 
v       ) 


ai(t)  =  n-p/joiCoo) 

Hence, 

P  (Y(t)edy(t)  I  1(0)  =  1, 1(t)  =  1,  Y(0)  =  y(0)} 


l-p: 


Ol(oo) 


(3.17) 
(3.18) 
(3.19) 


1 


^2JTy 


I-Pl 


1  2 

exp  j--(y(t)-y(0))  /2 


ai(oo)^ 


iVi 


aiM  \      (3.20,a) 


Similarly 

p{Y(t)edy(t),eed0 1 I(t)=2, I(0)=1,  Y(0)=y(0)} 

=— —  exp(-~  (y(t)-e)2/a2(~)2 1  dy(t)d6 

Oo(oo)  I     ^  J 


V  2rc  a2(°°) 


and 


P  (Y(t)edy(t)  I  I(t)=2, 1(0)=1,  Y(0)=y(0)}  =  l-dy(t)  (3.20,b) 

l-p2   • 

Suppose  item  j  is  estimated  to  be  the  one  observed  at  time  t  if  it 
maximizes 


P 


{l(t)=j 


I(0)=l,Y(0)  =  y(0)/Y(t)=y(t) 


It  follows  that 


P  {item  2  is  chosen  I  I(0)=1,  Y(0)=y(0),  I(t)=l} 


12 


=  PJp2(t)s2(0>pi(t)si(t) 


V^TTai(t) 


expj-^  (Y(t)-y(0))2/ai(t)2J|  1(0)=!,  1(0=1,  Y(0)=y(0) 


^(^»SVH>4l4 


=  p. 


-2  In 


nr-     ai      P2(t)s2(t)      /  t 

V27U     r-TPi(t)si(t)  A/2(1_Pl) 


<z 


(3.21) 


(-     t 


where  Z  is  a  standard  normal  random  variable  and  cci(t)  =    1-pj   o"i(°o). 


If 


Note  that  as  t->0,  the  probability  of  choosing  the  wrong  object  tends  to  0. 


Mt;-V27c      — -pi(t)Sl(t)  \  2 


i-Pi 

^      ) 


>i 


(3.22) 


then  the  conditional  probability  of  making  the  wrong  decision  is  1. 
If  k(t)  <  1  then 

P  {item  2  is  chosen  I  I(0)=1,  Y(0)=y(0),I(t)=l} 

=  2[l-<D(-2  1n(k(t)))]  (3.23) 

where  <I>  is  the  standard  normal  cdf.  Note  that  (3.23)  is  independent  of  y(0). 
As  ai  increases,  the  conditional  probability  of  making  the  wrong  decision 
increases.  Similarly  as  t  increases  the  probability  of  making  the  wrong 
decision  increases.  As  pi(t)si(t)  decreases,  the  probability  of  making  the  wrong 
decision  also  increases. 

In  the  case  in  which  pi(t)  si(t)  =  p2(t)  S2(t),  pi  =  p2  =  P>0/  an<3  c»i  =  a2  =  a 

1-pf 


Wt)  =  2>^.[1=^ 


i 

15 


13 


For  t  =  1,  k(t)  and  hence  the  probability  of  error  decreases  as  p  increases.   For 

t  =  2,  k(t)  =  yfln  a  for  all  values  of  p  and  so  the  probability  of  choosing  the 
wrong  item  increases  as  a  function  of  t.    The  limiting  value  of  k(t)  as  t— >°° 

once  again  depends  on  a(°°)  =  o7  *y  1-p2  .  Hence  as  p  increases  the  limiting 
probability  as  t— »<*>  of  choosing  the  wrong  item  increases.  Figure  3  displays  the 
probability  of  choosing  the  wrong  item  for  a  =  0.1  and  p  =  0,  0.5,  0.8,  0.9,  0.95 
(resp.  curves  A,  B,  C,  D,  E).  Note  that  for  t>2,  it  is  p  =  0  that  has  the  smallest 
probability  of  incorrect  identification.  These  results  depend  on  the  specific 
prior  (3.20,b).  In  the  next  subsection  we  will  consider  Gaussian  priors. 

3.3  The  parameters  Gi  and  02  have  Gaussian  priors 

In  this  section  we  will  assume  0j  has  a  normal  prior  with  mean  m  and 
variance  Tj  ,i  =  1,2.  Thus,  assuming  I  p,  I  <1, 


p  {Y(0)edy(0),  eede  I  l(0)=l} 
1  1 


V  2k  oi(°°)  V  2rc  xi 


exp 


\_  (y(0)-9)2    1  (9-ui)2 


dy(0)d9 


(3.24) 


V  27i  ai(o«>)  V  2tc  x\ 


i  (e-im(o))     l 

2       vi(0)  2 


•  dy(O)d0 


(3.25) 


where  straightforward  calculations  yield 


,.-21  1 

vi(0)     =  ~2  + 


ai(oo)  +n 


2=2  2 

xi      ai(oo)        x1  ai(«>) 


(3.26) 


mi(0)  = 


(y(0)/ 


O\(oo)   )    +    [Ul/T! 


vi(0) 


2  2 

X!  y(0)  +  01  (00)  Ul 

7~?       2 
ai  (00)  +t! 


(3.27) 


14 


UJ 


9"o  ro 

[dOdd3]d 
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Ri(0)  = 2 — t  (y(0)  -  m)2- 

Ol(oo)     +Xl 


with 


ai(<»)  =a14^-pi 


Therefore, 


p{eede|l(0)=l,Y(0)=y(0)}  =  -7= exp 

\  2rc  vi  (0) 

Similarly,  from  (2.4) 

p{Y(t)£dy(t),  0ede  1 1(0)=1, 1(t)=l,  Y(0)=y(0)} 


1  (e-miCO))' 


2      vi(0)2 


V^~cri(t) 


1 


exp 


-\  (y(t)  -  6  -  p!(y(0)-e))2/ai(t)2 


V  2ji  vi(0) 

1 1 

V  2tc  01  (t)    V  27C  vi(0) 


exp  -2  (e-mi(O))  /vi(0)     dy(t)d6 


exp 


!  (G-ai(t))      ! 
2        5l(t)  2 


where 


§i(t)  2  = 


t  2  2 

(1-Pl)  /<Ji(t) 


ai(t)  =  ^i(t) 


vi(0)  2] 
(1-Pi)[y(t)-Pty(0)]  (0) 


2  +2 

ai(t)  vi(0) 


and 


(3.28) 


(3.29) 


'  dy(t)d6  (3.31) 


(3.32) 


(3.33) 
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Ri(t)  = 


(yCO-piy^-rrnCOXl-pi) 


i2 


2" 2~ 

CT](t)  V]  (0) 


(y(t)-piy«)))-mi(0)(i-pi) 


A(i-p\)2vi(0)2+oi(t)2 


with 


2         2  2t  2 

ai(t)   =  O!  (1-pi  )/(l-pi). 


Thus, 

P  (Y(t)edy(t)  I  Y(0)=y(0),  I(0)=1, 1(t)=l} 


^|2KT\(t) 


exp|-2(y(t)-m(t))  Ai(t)' 


where 


(3.34) 


(3.35) 


Tl(t)2  = 


t  2  2  2 

(l-p^vitO)    +ai(t) 


(3.36) 


=  Ol(o°) 


(l-piSaiM  +Tl2(l-ptl) 


2        2 


t  2 

=  (1-pi)  oiM 


1  + 


(2        t       ,    X\ 
xl  +  Pi  <7lv°°) 


4  t  l+Oi(<») 


and 


Hl(t)  =  Piy(0)  +  mi(0)  (1-pi) 


(3.37) 
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Piy(o) 


2         2 
0\  (oo)     +  T1 


2  2 

1^(0)4-01  (°°)  Hi 


(1  "  Pi) 


CJl  («>)    +  Xi 


f  2  2      1       tf         |  2        2] 

hi  y(0)+oi(oo)  m  upi  y(o)J  ai(oo)  +  xx  I  - 


2  2 

1-^(0)  +  ai(~)  hi 


aiM  +xj 


2  2  t  2 

il  y(0)  +  ai(oo)  ji!  +  pjaiM  [y(0)-m] 
ai(~)  +xi 


,2,.     t 


Hl^lM  (1-p  i)  +  y(0)  ii  +  piaiM 


2       t 


,    ,2      2 
aiM  +  xi 


Similarly, 

P  (Y(t)edy(t)  I  Y(0)=y(0),  I(0)=1, 1(0=2}  = 
where 

2  2  2 

T2(t)    =G2(~)     +  T2 


V^Tx2(t) 


exp 


1  (y(t)-H2(0) 

2  2 
2         X2(t) 


(3.38) 


(3.39) 


and 


H2(t)  =  H2- 


(3.40) 


Once  again  we  will  estimate  the  identity  of  the  item  that  was  observed  at 
time  t  to  be  that  item  j  for  which 


Pj(t)sj(t)  f   l/n        ,  A2 .   . .: 

n  Tj(t)        exp   -2  (y(0  -  Hj(0)  Aj(t) 


(3.41) 
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is  the  largest. 
Thus, 

P  {choose  item  2 1  Y(0)=y(0)    ,  1(0)=!,    I(t)=l} 

=p{^-p{4(^')-^))2/W} 

>  ^(0  t  exP  {  -  \  (Y(t)-ui(t))2/n(t)2  }  I  Y(0)=y(0),  I(0)=1, 1(t)=l 
_  J  P2(t)s2(t)  f     1  21        pi(t)si(t)  {    12 

where  Z  is  a  standard  normal  random  variable. 
tl(t) 


c(t)  = 


X2(0 


Oi(oo) 


V^" 


v 


02M     +T2 


1  + 


(2        t      ,    .2^/2 


Tl  +PlOl(oo) 


L  V 


/  Tl+  Ol(oo) 


and 


d(t)  = 


ui(t)-U2(t) 

T2(t) 


1 


V 


/    \2         2 
a2M    +   T2 


(3.42) 


(3.43) 


(3.44) 


(3.45) 


t  2  2  2 

Pl(y(0)-Hi)  ai(eo)    +  (y(0)  -  U2)  T  !  +  (U1-U2)  Oi(oo) 

2      2 

01(00)    +t, 


Hence 

P  {choose  item  2 1  Y(0)=y(0)    ,  I(0)=1,    I(t)=l} 

=  pl-^MSSf)<<^z2-2^>z-d«2 


(3.46) 
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=  pj 


d(t)2 

1-C(t)2 


-2  In 


c(t) 


P2(0s2(t) 
pi(t)si(t)_ 


'Vi^Z-   CmW' 


\ 


V 


l-c(t) 


if|c(t)|<l 


If  pi(t)  si(t)  =  0,  then  item  2  will  always  be  chosen.  Assume  pi(t)  si(t)  >  0. 
If  p2(t)s2(t)=0,  then  clearly  item  2  will  never  be  chosen.  In  what  follows 
assume 

pi(t)  si(t)  and  p2(t)  S2(t)  are  both  positive.   Note  that  as  t— >0,  Ti(t)-»0,  c(t)-»0 
and 

P  {choose  item  2  I  Y(0)=y(0)    ,1(0=1,   I(t)=l}->0. 

Also,  as  X2— >°°  and/or  a2(°°)— »°°,  c(t)-»0,  d(t)-»0  and  the  conditional 
probability  of  making  a  wrong  decision  tends  to  zero  for  t>0.  Note  that  as 
o*i(t)— >«*>,  c(t)— **>,  d(t)— >o°,  and  the  conditional  probability  of  making  a  wrong 
decision  tends  to  1. 

The  unconditional  probability  of  a  wrong  classification  can  be  found  by 
taking  the  expected  value  of  (3.46)  with  respect  to  Y(0).  It  follows  from  (3.25) 
that  Y(0)  has  a  normal  distribution  with  mean  Hi  and  variance  G\  (°o)2  +  Tl2. 
Figures  4  and  5  show  the  probability  of  misclassification  for  the  case 
P2(t)  S2(t)  =  pi(t)  si(t),  n  =  %2  =  1,  oi  =  o"2  =  1,  Ui  =  1,  U2  =  2  and  p  =  0.0,  0.5,  0.8, 
0.9,  0.95  (resp.  curves  A,  B,  C,  D,  E).  The  integration  to  evaluate  the  probability 
is  performed  using  Gauss-Hermite  quadration  with  59  points;  cf.  A.  H.  Stroud 
et  al.  [1066]  and  Naylor  and  Smith  [1982].  Figure  4  shows  the  probability  of 
wrong  classification.  For  small  times  t  having  a  larger  p  results  in  smaller 
probabilities  of  error.  The  probability  of  wrong  classification  is  small  for  small 
values  of  t  and  then  increases  to  a  limiting  value  as  t— »°°.  The  limiting 
probability  of  wrong  classification  increases  as  p  increases.  Thus,  while  for 
small  times,  having  a  larger  positive  p  decreases  the  probability  of  wrong 
classification,  at  larger  times  it  increases  the  probability  of  wrong 
classification.  In  Figure  5,  each  probability  of  wrong  classification  is  divided 
by  its  asymptotic  (as  t— »°°)  value.  For  a  fixed  time  t,  for  a  higher  p,  the  fraction 
of  the  probability  of  wrong  classification  is  less  than  or  equal  to  that  for  a 
lower  p.  The  higher  p  is,  the  longer  it  takes  for  the  probability  of  error  to 
reach  its  asymptotic  value. 
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4.     Conclusions 

This  paper  considers  a  model  in  which  there  are  J  items  each  of  which  has 
a  characteristic  Signature  which  varies  in  time.  In  the  examples  studied  the 
Signature  process  of  each  item  is  an  AR(l)-type  process  independent  of  the 
other  items.  At  time  0  the  value  of  a  Signature  and  the  identity  of  the 
corresponding  item  are  known.  No  further  values  of  Signatures  are  observed 
until  a  later  time  t.  At  time  t  >  0,  a  Signature  from  an  unknown  item  is 
measured.  The  problem  is  to  estimate  the  identity  of  the  item  observed  at 
time  t.  The  estimation  procedure  studied  is  to  estimate  the  identity  of  the 
unknown  item  to  be  that  one  which  maximizes  the  posterior  probability  of 
producing  the  observed  signature.  The  probability  of  correct  identification 
depends  on  the  parameters  of  the  processes  and  the  magnitude  of  t.  The 
smaller  t  is  the  greater  the  probability  of  correct  identification  of  the  unknown 
item.  For  fixed  time  t  a  higher  positive  correlation  results  in  a  lower  fraction 
of  the  probability  of  wrong  classification  with  respect  to  its  limiting  (as  t-»°°) 
value. 

It  appears  that  the  problem  of  this  paper  resembles  the  "missing-data 
problem"  of  statistics;  see  Little  and  Rubin  (1987).  We  plan  to  investigate  the 
connection  more  extensively  in  future  work. 
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